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Amendments to the Claims: 

A listing of the entire set of pending claims (including amendments to the 
claims, if any) is submitted herewith per 37 CFR 1 .121. This listing of claims will 
replace all prior versions, and listings, of claims in the application. 

Listing of Claims: 

1 .(Currently Amended) A system for integrative analysis of intrinsic and 
extrinsic audio-visual data, the system comprising: 

an intrinsic content analyser, the intrinsic content analyser being 
communicatively connected to an audio-visual source, the intrinsic content analyser 
being adapted to search the audio-visual source for intrinsic data and being adapted 
to extract intrinsic data using an extraction algorithm, 

an extrinsic content analyser, the extrinsic content analyser being 
communicatively connected to an extrinsic information source, the extrinsic content 
analyser being adapted to search the extrinsic information source and being adapted 
to retrieve extrinsic data using a retrieval algorithm, and 

a processor configured to correlate the intrinsic data and the extrinsic data for 
providing a multisource data structure, wherein the a udio - v i sua l sourc e - is - a - fi l m and 
th e e xtr i ns i c i nform a t i on source is a fi l m scr ee np l ay wr i tt e n b e for e product i on of th e 
fil mintrinsic content analyzer, the extrinsic content analyser, and the processor are 
included in a single device . 

2. (Previously Presented) The system according to claim 1, wherein the 
retrieval of the extrinsic data is based on the extracted intrinsic data. 

3. (Previously Presented) The system according to claim 1, wherein the 
extraction and/or retrieval algorithm(s) is/are provided by a module. 
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4. (Previously Presented) The system according to claim 1 , wherein a query is 
provided by a user, the query being provided to the extraction algorithm and wherein 
the intrinsic data is extracted in accordance with the query. 

5. (Previously Presented) The system according to claim 1 , wherein a query is 
provided by a user, the query being provided to the retrieval algorithm and wherein 
the extrinsic data is retrieved in accordance with the query. 

6. (Previously Presented) The system according to claim 1, wherein a feature 
reflected in the intrinsic and extrinsic data includes textual, audio and/or visual 
features. 

7. (Previously Presented) The system according to claim 1, wherein the 
extracted data include textual, audio and/or visual features. 

8. (Previously Presented) The system according to claim 1, wherein the 
extrinsic information source is connected to and may be accessed via the Internet. 

Claim 9 (Canceled) 

1 0. (Previously Presented) The system according to claim 1 , wherein the 
extrinsic content analyser include knowledge about screenplay grammar, and 
wherein the extrinsic data is retrieved based on information extracted from the 
screenplay by use of the screenplay grammar. 

1 1 .(Currently Amended) The system according to claim 1 , wherein the 
identification (§)-of persons in a film is obtained by means of the screenplay. 

12. (Previously Presented) The system according to claim 1 , wherein a feature 
in a film is analysed based on information included in the screenplay. 
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13. (Previously Presented) The system according to claim 1 , wherein the 
correlation of the intrinsic and extrinsic data is time correlation, thereby providing a 
multisource data structure where a feature reflected in the intrinsic data is time 
correlated to a feature reflected in the extrinsic data. 

14. (Currently Amended) The system according to claim 1 3, wherein the time 
correlation is obtained by an alignment of a dialogue in the screenplay to the spoken 
text (10 4 ) in the film and thereby providing a timestamped transcript of the film, 

15. (Previously Presented) The system according to claim 14, wherein a 
speaker identification in the film is obtained from the timestamped transcript. 

16. (Previously Presented) The system according to claim 1 , wherein the 
screenplay is compared with the spoken text in the film by means of a self-similarity 
matrix. 

1 /.(Previously Presented) The system according to claim 1 , wherein a high- 
level information structure is generated in accordance with the multisource data 
structure. 

18. (Previously Presented) The system according to claim 17, wherein the 
high-level information structure may be stored on a storage medium. 

19. (Previously Presented) The system according to claim 17, wherein an 
updated high-level information structure is generated, the updated high-level 
information structure being an already existing high-level information structure which 
is updated in accordance with the multisource data structure. 
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20. (Previously Presented) The system according to claim 1, wherein the 
retrieval algorithm is a dynamic retrieval algorithm adapted to dynamically update 
itself by including additional functionalities in accordance with retrieved extrinsic data. 

21 .(Previously Presented) The system according to claim 20, wherein the 
additional functionalities is obtained by training the retrieval algorithm on a set of 
features from intrinsic data using labels obtained from the extrinsic data. 

22. (Previously Presented) The system according to claim 1, wherein the 
training is performed using at least one screenplay. 

23. (Currently Amended) The system according to claim 1 , wherein an 
automatic ground truth identification in a film is obtained based on the multisource 
data structure for use in benchmarking algorithms on audio-visual content. 

24. (Currently Amended) The system according to claim 1 , wherein an 
automatic scene content understanding in a film is obtained based on the textual 
description in the screenplay and the audio-visual features from the film content. 

25. (Currently Amended) The system according to claim 1 , wherein an 
automatic labelling in a film is obtained based on the multisource data structure. 

26. (Currently Amended) A method for integrative analysis of intrinsic and 
extrinsic audio-visual information, the method comprising the acts of: 

searching by a device an audio-visual source for intrinsic data and extracting 
intrinsic data using an extraction algorithm, 

searching by the device an extrinsic information source and retrieving extrinsic 
data using a retrieval algorithm, and 
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correlating by the device the intrinsic data and extrinsic data, for providing a 

i nformation sourc e i s a fi l m scr ee np l ay written b e for e production of th e f i lm . 

27. (Previously Presented) The method according to claim 26 further 
comprising the step of generating a high-level information structure in accordance 
with the multisource data structure. 



28. (Previously Presented) The method according to claim 26, wherein the 
extrinsic content analyser include knowledge about screenplay grammar, and 
wherein the extrinsic data is retrieved using information extracted from the 
screenplay by use of the screenplay grammar. 



29. (Previously Presented) The method according to claim 26, wherein the 
retrieval algorithm is updated by training the algorithm on a set of extrinsic data. 



Claims 30-32 (canceled) 
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